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Abstract: We develop nonlinear renewal theorems for a perturbed random 
walk without assuming stochastic boundedness of centered perturbation terms. 
A second order expansion of the expected stopping time is obtained via the 
uniform integrability of the difference between certain linear and nonlinear 
stopping rules. An intermediate renewal theorem is obtained which provides 
expansions between the nonlinear versions of the elementary and regular re- 
newal theorems. The expected sample size of a two-sample rank sequential 
probability ratio test is considered as the motivating example. 



1. Introduction 

Let X, X n ,n > 1, be i.i.d. random variables with a finite, positive mean EX = /i. 
Let {Z n , n > 1} be a perturbed random walk defined as 

(1.1) Z n = S n +C n , S n =X 1 + --- + X n , n>l, 

where {£„, n > 1} are random variables such that {X\, £i, . . . , X n , £„} are indepen- 
dent of {X n+ j, j > 1} for all n > 1. Define 

(1.2) T b = inf{n > 1 : Z n > b}, r b = inf{n > 1 : S n > b}. 

Nonlinear renewal theory studies probabilistic quantities related to stopping rules 
Tb, especially Blackwell-type theorems for the convergence of the renewal measure 
Ub((b,b + h]) = ^2 n P{b < Z n < b + h}, the distribution of the excess over the 
boundary R b = Zx b — b, and expansions of ET b and Var(Tfc), as extensions of the 
(linear) renewal theorems concerning probabilistic quantities related to T b . Many 
important applications of nonlinear renewal theory come from sequential analysis in 
which nonlinear renewal theory provides crucial analytical tools and methodologies 



Many authors have studied nonlinear renewal theory. See for example Chow 
and Robbins m , Chow [3( , Siegmund 1231 ]2$ . Gut [9|] , Pollak and Siegmund [18( , 



Woodroofe [26|, l2_7( , Lai and Siegmund [la , llq , Chow, Hsiung and Lai J] , L alley 
0, Hagwood and Woodroofe 0, Woodroofe and Keener j^, Zhang jaJ^Hu [Tlf, 
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Aras and Woodroofe Jl, Kim and Woodroofe [3 El, and the books by Woodroofe 
[28| and Siegmund [251] on the subject. A main condition of the existing Blackwell- 
type nonlinear renewal theorems is 



(1.3) limlimsupP< max 

9^0 IWOO \l<j<en° 



> e } = 0, Ve > 0, 



(Lai and Siegmund [l5j). This condition of slowly changing perturbation allows 
with unbounded variability [i.e. stochastically unbounded £ n — c(n) for any center- 
ing constants c(n)]. However, in addition to (|1.3p and other regularity conditions, 
existing results on the second order [i.e. up to o(l)] expansion of ETb requires 

(1.4) the uniform integrability of max — f(j) 

NoVn<j<n-\-n a 

for certain 1/2 < a < 1, where /(t) is a slowly changing deterministic function and 
N is a random variable with E N a < oo [l5| • This condition precludes perturbation 
processes with unbounded variability. In this paper, we remove the restriction 
on the bounded variability of £ ra by imposing the condition of 

(1.5) the uniform integrability of max I \£ n +j ~ Cn| A n a 

l<j<Mn a V 

for all Mel, instead of (|1.4[) . where ( n are certain truncated £„. This will be done 
in Section 2. 

Blackwell-type nonlinear renewal theorems and second order expansions of ETb 
were first obtained by Woodroofe [26j for stopping rules of the form 

(1.6) T b = inf jn > 1 : S n > A(n;6)} 

with certain nonlinear boundaries A(-;6). Lai and Siegmund (TBI, [lij pointed out 
that in many applications (| 1 .6(1 can be written as (|1.2p for certain (possibly different) 
random walk with perturbation and developed nonlinear renewal theorems for (|1.2jl 
under much weaker conditions on the distribution of A. Zhang [32| studied nonlinear 
renewal theorems for both (|1.2p and (|1.6[) through the uniform integrability of 
1 7b — Ta| p , where a = 6 — f(b/[i) with the function /(£) in (|1.4[) . He also obtained 
a second order expansion of Var(Xf,) for stopping rules of the form (jl.6p . and thus 
demonstrated certain advantages of investigating ()1.6j) . The methods in Zhang 
and here can be combined to study a general form of stopping rules with (|1.2|l and 
(|1.6|) as special cases, but for simplicity we confine the rest of our discussion to 
stopping rules of form (|1.2[) . 

The motivating example of this paper is Savage and Sethuraman's [21( two- 
sample rank sequential probability ratio test (SPRT) for G — F against a Lehmann 
alternative. In Section 3 we provide formulas for the expansion of the expected 
sample size of the rank SPRT, with an outline of a proof. Our calculation shows 
that the rank log-likelihood ratio is of the form {T7TJ) such that (£ n — E£ n ) / (log n) x / 2 
converges to a nondegenerate normal distribution under the null hypothesis, so that 
we arc truly dealing with perturbations of intermediate order. 

Our expansion of ET^ is obtained via the uniform integrability of |T& — t?\ under 
(|1.5|) . where 75*, defined in (|4.1j) below, is a linear stopping rule with perturbation at 
an initial time n = n*. In fact, we will develop sufficient conditions for the uniform 
integrability of — t£\/ p{b)} p for certain normalization constants 1 < p(b) = o(b) 
and consequently an intermediate renewal theory for the expansion of ETb up to 
0(p(b)). These will be done in Section 4. 
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2. Expectation of stopping rules 

In this section, we provide a second order expansion of ET\, under (|1.5j) . Let p(x) 
be a function satisfying 

(2.1) 1 < p(x) = o(x) as x — > oo , sup sup p(t)/p(2x) < oo. 

x>l x<t<3x 

We shall first state a general set of regularity conditions on the perturbation £ n in 
(|l.ip which we call p-regularity. We denote throughout the sequel |_^J the integer 
part of x and \x~\ the smallest integer upper bound of x. 

The process {£«} in is called p-regular, or regular of order p(-), with pa- 

rameters p > 1 and l/2<a<lif the following three conditions hold: there exist 
constants 6o > 0, 9 > 0, 9 < p for a = 1, K > 0, wq > and < 9* < Kp such 
that 

(2.2) P{ _ max & > 9n a \ = o(p(n)/n) p : 



(2.3) ^ P- 1 P{a-<-(fc-^M + ^ofc"}=o(/(n)), 

k>7i-\-Kn a 

and that for („ = (£„ A 6>n Q ) V (-6>*n Q ) and all M < oo 

(2.4) i max |— — I ^ n j n > 1 1 is uniformly integrable. 

\o<j<Mn* \ p{n) / J 

We impose the 1-regularity with p(x) = 1 in Theorem 2.1 below for the expansion 
of ETb and the general p-regularity in Section 4 for uniform integrability and an 
intermediate renewal theorem of order p(-). 

Theorem 2.1. Suppose {£,n,n > 1} is 1-regular, i.e. p(x) — 1, with parameters 
p = 1 and 1/2 < a < 1. Suppose X is non-lattice with EX = p > and _E|X| 2 / Q < 
oo. Suppose bP{Ti, < S b/p} = o(l) /or £/ie (5 in, (|2.2p and £/ie slowly changing 
condition 

(2.5) max \£ n+j - £ n | = o P (l) 

l<j<n a 

ZioZds u»'#i t/ie Cn = (£„ A 6»n Q ) V (-6»*n Q ) m (O- T/iera, as 6 ->■ oo, 
(2-6) = b - EC, lb + ^g- + o(l), 

where n\, — \ b/ p\, S n is as in (jl.ip and tq is as in (|1.2p . 

Remark 2.1. As mentioned earlier, the main difference between the p-regularity 
and the usual regularity conditions in the nonlinear renewal theory literature is 
(|2.4[) . which allows £ n to have unbounded variability as n — > oo. 

Remark 2.2. Since (k — n)/k a is increasing in k, (k — n)p — w$k a > (pK/(l + 
K) a — wo)k a for k > n + K(np) a . Thus, (|2.3p is a consequence of 

oo 

(2.7) 5I F ~ lp {-£ fc ^ Wlka } < 00 

fe=i 

for certain w\ > 0. In typical nonlinear renewal theorems, p(x) = 1 and (12. 7p is 
imposed (with w\ < p for a = 1) instead of (|2.3p . 
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Remark 2.3. The condition bP{T b < 5 Q b/n} -> holds if EX 2 < oo and 

nP{maxj< n £j > w^n} — o(l) for some W2 < 5o — 1)- 

Proof of Theorem 2.1. Let T = T 6 be as in fL~2]) . n* = [b/fx - r;*& Q J, and r* = 
r b * = inf{n > n* : 5„ + Cn» > be as in (|4.1|) below with 77* > 0, 77, < 1/n for 
a = 1. Let i?J = S T * + Cn, — & be the overshoot for r*. Since („, is bounded and 

b ~ Cn, ~> OO, 

(2.8) /j£t* - £S r * - £i? b * + 6 - E( n , = b - E£ n , + ^§2- + o(l) 

by the Wald identity and the standard linear renewal theorem [7|. The proof is 
based on (|2~%|) . (O with p(-) = 1, ([2~5]) , and the uniform integrability of |T - r*| 
in Theorem 4.1. 

Since E\T - t*\ is bounded, ET < 00 and ^£(T - r*) = £(S r - S r ») by the 
Wald identity. Let R b = Z T - b be the overshoot for T in ([L2]) . By |L2]) and gj} 

(2.9) S T - St* = (i? 6 + 6 - fr) -(R* T + b- C„, ) = i? fc - i? h * + (C„, - £r). 

Since iJX 2 < 00, the uniform integrability of \T — r*| implies that of \St — 6V*|. 
Since C„, = 0{b a ), |r* - = P (6 Q ). This and T - t* = O p (1) imply 

(2.10) |T-6//^l + k*-V^I = Op(6 Q ), 

so that Cn, — = op(l) by ()2.5|) . Moreover, ()2.10j) and ()2.5|) imply the convergence 
of both Rb and R b in univariate distribution to the same limit [la ] . These facts and 
the uniform integrability of \St — S T * \ imply (J>E(T — r*) = E(St — S T *) — > in 
view of (EU). It then follows from fl^ that ST = b - E( n , + ES 2 J(2ES To ) + o(l). 
Since £7|Cn. - Cn b \ -> by JU]) and (|23]l . ([23]) follows. □ 



3. Rank SPRT 

Given a constant A > and two independent samples of equal size from continuous 
distribution functions F and G respectively, the rank likelihood ratio for testing 
Hq : G = F against the Lehmann alternative G = F A is A„ = L n (F, F A )/L n (F, F), 
where L n (F, G) is the probability mass function of the ranks of the F-sample within 
the combination of the F- and G-samples. Suppose pairs of observations, one from 



F and one from G, are taken sequentially, the rank SPRT [2l| rejects Ho iff Ap > e b 
with the stopping rule 

(3.1) T = T a , b = inf {n > 1 : Z n < -a or Z n > &}, Z n = log A„. 

In this section, we provide formulas for the expansion of the expectation of the 
sample size (|3 . 1 1) of the rank SPRT under the following conditions: 



(3.2) G = F A , M = logA + J\ g(-^^jd{F + G)^Q. 

We outline a proof of the expansion via a representation of the rank log-likelihood 
ratio Z n in (|3. 1|) as a perturbed random walk (jl.ip satisfying the conditions of The- 
orem 2.1. We prove in (|3.9p the convergence of (£„ — E^n) /(log n) 1 / 2 in distribution 
under the null hypothesis, so that the rank log-likelihood is truly a random walk 
with perturbations of intermediate order. 
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The rank likelihood ratio was considered earlier by Savage [13] who showed that 

(3.3) Z n = log (A n (2n)l) - n J log(nF„ + AnG n )d(F n + G n ), 

where F n and G n are the ECDF's of the F- and G-samples. Chernoff and Savage 
provided Q representations of certain rank statistics as (jl.ip and proved their 
asymptotic normality, i.e. = op(n 1//2 ). Lai identified the rank log-likelihood 
ratio i? n with a Chernoff-Savage statistic and proved the quick convergence n~ 



for all e > in . The problem was further investigated by Woodroofe 28|, l29| 
who proved (|1.3|) for the perturbation term of (|3.3j) and derived asymptotic formulas 
for the error probabilities of the rank SPRT. Our results are based on a finer 
expansion of (|3.3p from a slightly different expression (|3.4p below. 

Let H — F + G, W = F + AG, and H n and W n be their empirical versions. 
Since log((2n)!) = n J \og(nH n )dH ni (|3 . 3|) can be written as 



(3.4) 



Z n = nlog(A) +nj\og (Jj^jdH n . 



Let f/'n = H n /W n and ■0 = -ff/W 7 . We write f|3.4|) as a perturbed random walk (jl.ip 
with 

(3.5) £„ = n log A + n J \og(^)dH n +n J (H n /H - W n /W)dH 
and the perturbation term 

(3.6) £„ = [n{]og(1> n /il>)dH n -(H n /H-W n /W)dH}. 

Let j/fc be hypergeometric(n, n, fc) variables and 77 = (1 — A)/(l + A). Define 



2ri 



C( ?7 )=lim^ J Blog(l + » ? (^-l)) + !Li og (2 



fc=i 



The above limit exists since Eyj. = fc/2 and Var(j/fc) = (fc/4)(2n — k)/ (2n — 1). We 
state our expansion of the expectation of the sample size (|3.ip as follows. 

Theorem 3.1. Set 77 = (A - 1)/(A+1). Let T afi , S n , and t be as in (f3~T]> . (j3"3|) . 

and (II. 2p respectively. Suppose fj, > in (13. 2p and a/log& — > 00 as & — > 00. Then, 

(3.7) /x^ a , b = 6 - ^ n „ + ESl/(2ES T0 ) + o(l), 

where nb = [b//j,\ as in Theorem 2.1. Moreover, if G — F A , then 



b - J h(x)d{x + x A ) + ES 2 T J{2ES T0 ) + o(l), A ? 1 

b - (n 2 /2) log(26//i) + C(ry) + ES*/(2ES n ) + o(l), A = l, 



where h{x) = (1 - A)V+ A /{2(a: + Ax A ) 2 (x + or 4 )}. 

Remark 3.1. Since A„ = L n (G 1 ^ A ,G)/L n (G,G), Theorem 3.1 also provides ex- 
pansions of ET a j, for /i < as (a, 6/ log a) — > (00, 00) by symmetry. 



Nonlinear renewal theory 



169 



Here is an outline of a proof of Theorem 3.1. For eo < a, P(Z n < 0) < P(\Z n — 
nfi\ > eon) — > exponentially fast [2l[. Since P(|Z„| < n|logA|) = 1, this implies 
P(Z Tai < 0) = o(fe 2 ), so that ET a , b = ET b + o(l). Thus, it suffices to consider 
a = oo (T a fc = Tb). Moreover, the same argument proves bP{T b < Sobf/j,} = o(l) 
for all Sq < 1. 

Let M* denote universal constants. For c„ > 1/rt, we split the integral for £j in 
()3.6|) according to whether -ff(x) < c„ so that 

Since ^ = (jHj)/(jWj) with jflj and JWj being sums of iid measures, Cn,j+i ~ 
if f H<c d{(j + l)Hj + i— jHj} = 0. Thus, by algebra and the Taylor expansion 

of iog(v>j+iM)i 

I^S+i - #J \<M* I {1 + log n - log(ff/2)}d{(j + - 

JH<c n 



due to d{(j + 1)^+1 - jW,-} < (1 V A)d{(j + l)if i+1 - ji^} and / {l/H n )dH n = 

2) 

2 



Sfe=i V^- For the four term Taylor expansion of log(ipj/ip) yields 



E max 

n<j<2n 



£( 2 ) _ f/W. _ U _ 1 )(7 [ 2 ]. 



< M*/(nc„), 

where {U^L j > 1} are ^-statistics with kernels U^\. such that 



E 



Tj[l] 



<M*log(f), Var(^) <^1, 2*(tf&) ' < A/' log ( f ) , 



with completely degenerate U [ n 2 . Choose c„ satisfying (logn)c n n a + l/(nc„) = o(l), 
we find that the above five inequalities imply the 1-regularity of £ n for p = 1 and 
all 1/2 < a < 1. 



Proposition 3.1. TTie ranfc log-likelihood ratio Z n in (|3.ip arid (|3.3[) can 6e written 
as a perturbed random walk Z n = S n + £ n with the random walk S n in (13 . 5[) . drift 
u in (|3.2[) . and £/ie perturbation £ n in (|3.6[) . Moreover, for all 1/2 < a < 1 and 

e>0,£max i <„<. |£n+j-£n| = o(l), .E(|£„|-n a ) + = o(l), n?{ max <j< n |£ n +il > 
en a } = o(l), and £„P{|£„| > en"} < oo. 

It follows from (|3.5j) that 5*1 is non-lattice with i?|,5'i| p < oo for all p. Since we 
have already proved bP{T b < Sob/ ft} — o(l), all conditions of Theorem 2.1 hold by 
Proposition 3.1. Thus, (|3.7p holds and it remains to compute E£ n up to o(l). We 
sketch below the calculation in the case of F = G, 

Assume F = G are uniform in (0, 1). Let ui < ■ ■ ■ < U2n be the ordered ob- 
servations in the combined sample. Let e k = 1 if itfc is from G and e k = oth- 
erwise. Set y k = J2i=i e i- Since y k = nG n (u k ) and k = nH n (u k ), / ip n ){uk) = 



1 + r/(2y fc /fc - 1), so that by (|3~6| 

2n 2n 

(3.8) £„ = - lo § ( X + *7(W* - 1)) + V(2y k - k) \og{u k+1 /u k ) 

k=l k=l 
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with U2n+i = 1< Since yu ~ hypergeometric(n, n, fc), -Ej/^ = fc/2. This and the 
independence of {yk} and {u/c} imply 

EC n = ( V 2 /2) log(2n) - C{rf) + o(l). 

Thus, the expansion in Theorem 3.1 holds for A — 1, in view of (|3.7p . 

Since {v,k — itfe-i)/itfc are independent beta(l, fc — 1) variables, (13 . 8|) implies 

(3.9) 4/" S^W* MW,M 

^ Jl/(2n) * Jl/{2n) 1 

«££„ + 7v(0,(77 4 + 77 2 )logn), 

where Bo(") is a Brownian bridge, Wi(-) is a Brownian motion independent of -Bo(O) 
and £„ ~ £^ means has the same limiting distribution as after centering by 
-E 1 ^ and normalization by ylogn. Thus, condition (|1.4|) of the existing nonlinear 
renewal theorems does not hold. 



4. Uniform integrability and an intermediate nonlinear renewal 
theorem 

The results in this section are obtained by comparing Tb in (|1.2[) with 

(4.1) r b * = inf {n > n* : S n + Cn, > b}, 

where Cn is as in (|2.4p and n* = L£>/ ^ — n*b a \ for certain 77* > 8/p 1+a , rj* < 1//U 
for a = 1. We shall state all the results before proceeding to the proofs. 

Theorem 4.1. Suppose that > 1} is p-regular with parameters p > 1 and 

1/2 < a < 1. Suppose that the stopping time Tb in (|1.2p satisfies 

(4.2) lim (p(6)/&) P P{T 6 < <5 &//x} = 
for the 5 in $F2$. If E\X\b +1 V a < 00, then 

:b>l\ is uniformly integrable. 

For p{x) — 1 and p = 1, this uniform integrability result is a crucial component 
in our proof of the second order expansion of ETb in Theorem 2.1. It can be also 
used to derive expansions of the expectations of the renewal measure Ub and the 
last exit time N£, where 

00 

(4.4) U b = HZn < &}, N; = 1 + sup {n > 1 : Z n < b} . 

71=1 

For general p(-), it yields an expansion of ETb up to O(pjb)). Since p(b) = o(b) 
(e.g. p(b)/b e — > for all e > with the rank SPRT by Lai [lj], as shown in Section 
3), such an expansion is typically sharper than direct extensions of the elementary 
renewal theorem but cruder than Theorem 2.1 as an extension of the standard 
renewal theorem. Thus, we call Theorem 4.2 (i) below an intermediate nonlinear 
renewal theorem. 



(4.3) 



Pib) 
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Theorem 4.2. (i) Suppose the conditions of Theorem 4.1 hold with p = 1. Then, 
for certain finite M , 

pET b = b - EC nb + 1 + E max (|£ n , +j - Cn, I A n a ) } 

[ -> =b-E( nb +0(p(b)). 

(ii) Suppose the conditions of Theorem 4.1 hold with p = 2. Then, 

(4.6) Var(T b ) = ^ + 0(Vbp{b) + p 2 (b)), as b ^ oo. 

M 

Remark 4.1. The conclusions of Theorem 4.2 remain valid if we replace the o(l) 
in (|2~2"1) and (j2~3"| with 0(1) and (|2T4")) with the weaker 



P max 

i<j<Mr. 



J (lCn-6 l+ ,l p An^) =0(^(6)). 

In a \ / 

Theorem 4.3. Let Ub and N£ be as in (]4.4[) . Suppose 

(4.7) Y, kP ~ lp I >"!>./ + U - n)/x) < w 1 = °(p»), 

fc>n+ifn° J 



for some K > and w > as in (|273|l . TTien, (|4~3j) . (|4~5j) and (|4~6[) Wd wii/i T b 
replaced by either Ub or N b * under their respective conditions in Theorems 4-1 and 
4.2. 

Proofs of of Theorems 4.2 and 4.3 are omitted since they follow from standard 
methods in nonlinear renewal theory, cf. [2{| or [32| ■ We need three lemmas for the 
proof of Theorem 4.1. 

Lemma 4.1. Suppose E\X\ ( -P +1 ^ a < oo. If $£B) and (T£§) hold for certain 9 > 0, 
then P{T b < b/p: - ^b a } = o(p(b)/b)P for all ??» > 9/p 1+a . 

Proof. Let w > satisfy (1 - w)p 1+a n t , = 9 with the 9 in ([2~2]) . Let b > 1 and 
n* = [b/p - ri*b a \. Let S be as in and ([4^2) , By (|T2"]) 

< P{S n + £„ > b for some dob/ p < n < n»} 
( 4 - 8 ) r -I 

< P\ max S„ — np > wpp^b a > 

I l<n<n* ' J 

+ P< max (£„ + n/x) > b — wpp^,b a >. 

I Son* <n<n* J 

Since E\X\'-P +1 '>/ a < oo, by Theorem 1 of Chow and Lai [j| 
(4.9) pf max |S*„ - np\ > \b a \ = o(b- p ), VA > 0. 

L l<n<b J 

Thus, the first term on the right-hand side of (I4.8[) is of the order o(b~ p ) since 
n* = 0(b). Since 6 — wpr)*b a — n^p > (1 — w)pp st b a > (1 — w)p 1+a i]*n" = 9n" and 
p(n*) is of the same order as p(b) by (|2.ip . it follows from (|2.2p that the second 
term on the right-hand side of (|4.8[) is bounded by 

Pf max > 0<) = oWfi,)/",)" = o(p(b)/bY. 

Hence, (|4.8[) is o(p(b)/b) P and the conclusion follows from (|4.2[) . □ 
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Lemma 4.2. Suppose E\X\ ( -P +1 ^ a < oo. If (fO|) holds for certain K > 0, then 
, lim ~Vi~h\ E >k} = 0, r? = K/p a . 



Proof. Let n* = \b/ fi + r)*b a ]. By fT 

OO OO 

(4.10) kP ~ lp {Tb >k}<J2 k^PiSk + & < 6} 

k—n* k—n* 
oo 

< ^ F^P^ < kfj,- w k a /2} 

k—n* 
oo 

+ k p - x P{^ k <b-kfi + w k a /2}. 

k—n* 

Since E\X\ ( P +1 ^ a < oo, by Theorem 1 of Chow and Lai @ 

OO 

(4.11) ^ P{\S n ~ M > Xn a | < oo, VA > 0. 

n=l 

Thus, since wo > 0, the first term on the right-hand side of (|4.10j) is o(l) as 
b — ► oo. Let nb = [b/fi\ as in Theorem 2.1. Since nb/x < fe < (rift + l)^i and 
n* > nb + rj*{nb^i) a = nb + Kn^ , in view of (|2.3j) the second term is bounded by 

J2 k^P^k < (n b + - + i«ofc a /2} = o(p p (n b )). 

The conclusion follows since p{rib) and are of the same order. □ 

Lemma 4.3. Suppose E\X\^ p+1 ^ a < oo. Let fee as in (14. ip im'f/i £/ie r)* in 
Lemma 4-1- Then, 

(4.12) P{b/p - n»b a < t* < b/yt + n* T b a } > 1 + (6- p ) 
/or all rj* > 0* / fi 1+a . Moreover, for such ry* 

(4.13) lim V fc^Pfo* > fc} = 0. 

k>b/ fJ.-\-7]* b a 

Proof. Since fe — — On" > prj^b a — On" > (n*p 1+a — 0)n" > 0, it follows from 
dlU) that 

P{r fe * = n*} < P{S„, + On? > 6} 

= P{S n , - >b-n,n- 0n°} = o{b- p ). 

Letn* = ffe/V+^fe"]. Since b-n*n+6*n° < -fin* T b a +0*n* < -(r)*n 1+a -9*)n™ < 
0, we have 

PH > <} < P{S„. - r< < fe} 

= P{S K -n* T p<b- n*n + 0*<} = o(fe- p ). 

The above calculations prove (|4. 12|) . The proof of (|4. 13|) is simpler than that of 
Lemma 4.2 and omitted. □ 
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Proof of Theorem 4.1. Let 77,, rf = K//j, a and rf > r\* > 9* /[i 1+a be as in Lemmas 
4.1, 4.2 and 4.3 respectively. This is possible since 9* < K[i with the p-regularity 
conditions. Set n* = [b/fj, - r]*b a \ , n* = \b/n + r/*b a ~\ and n* = \bj\i + r£b a '\ . 
Step 1: We first prove that for all integers fc* > 1 

00 

J2 V- l P{T b - r* b > k} 

k=k, 

< 2 k^Pin > k) + J2 w^pH < n*} 

k>n* n* — n* <fc<n* 

+ J2 kP~ 1 P{A T ) + J2 kP- 1 P{S k < iik/2) 

k* <k<n* — n* k# <fc<n* — n* 



(4.14) 



fc* <fc<n* — n* 

with A r = {r b * ^ (n*, n*)} and M T = 77* + 77* + 2r/», and 



J2 kp-'p^ -n>k) 

k=k„ 

<2j2 kP ~ lp { T b> k }+ fe p_1 -P{T6<n*} 

/ . 1 k~>n* n* — n*<fc<n* 

+ J] F~ 1 P{2 T }+ J] F- x P{S fc <^/2} 



max 

l<j<2+M T b a 



V fc p-1 p{ max -Cn.)>M*/2) 



A:* <A;<n* — n* 

with A T = {T b <£ ( n*,n* ), t* > T b ) and M T = V* + V*- 

For the proof of (|4. 14[) . we divide [fc», 00) into three intervals at n* — n* and n* . 
For the first interval k € [fe*, n* — n*), we have < r b * + fc < n* + n* — n» — 2 < 
n* + 2 + AI T b a in A£ and 

{T b - T* > fc} C {Srf+k + ZT;+k < b < S T , + Cn, } 

C {S r; +h - S T ; < /jfc/2} U {Cr'+fe - Cn, < -lik/2}. 

For the second interval k e [n* — n*, n*), we have 

2 ^"^{Tfc > fc + r 6 *,r b * >n*}< ^ fcP- 1 J P{r 6 > fc + n*} 

fc>n* — n* k>n* — n* 

< £ i p_1 ^>i}- 

The proof of (|4.15|) is nearly identical, with n* < 71 < n* < n* + (77* + i]*)b a + 2 
in Ay and 

{r b * - T b > k} C {5 T6+fc + Cn. < & < S Tb + } 

C {S Tb +k - S Tb < fik/2} U {Cn, - fr 6 < -nk/2}. 

Step 2: Prove the uniform integrability of {(T b - r b ) + /p(b)} p . For fc* = LC/°(^)J 1 
we have 

,ftc) -*W- c )''W >c 
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' v 1 k=k, 

where C p is a universal constant. For the current step, it suffices to show J(6, C) — > 
as 6 — > oo and then C — > oo. Since n* = 0(6) and n* — n* = 0(6"), it follows from 
(|4~T4]) . Lemmas 4.2 and 4.3, and (j4~TTT) that 

J( b , C) = (1) + E ^^n, - > 

Since 6 = 0(n*), we may choose M in ()2.4p satisfying MnJ > 2 + M T b a for all 
6 > 1. Thus, by the uniform integrability in (12. 4p . J(b,C) = o(l) as 6 — > oo and 
then O — ► oo. 

5iep 5: Prove the uniform integrability of {(T& — T h *)~/ j o(&)} p . This step is nearly 
identical to Step 2, with ()4.15j) instead of (|4.14| . In fact, since Mt < M T , the same 
M in (23) works. Although Lemma 4.1 does not provide (b a /p(b)) p P(T h > n*) = 
o(l), we have P(A T ) < P(T n < n*) + P(r b * > n* > n*), so that Lemmas 4.1 and 
4.3 can be used to control the third sum on the right-hand side of (14. 1 5|) . This 
completes the proof of Step 3 and thus the entire theorem. □ 
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